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Evaluation of the Williams-'I^rpe Spring Wheat Model in North Dakota and 
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ABSTRACT 


rne Williams-Type Model was developed similarly to previous models of G.V.D. 
Williams. The models use monthly temperature and precipitation data as well as 
soil and topological variables to predict the yield of the spring vdieat crop. 

The models are statlstloally developed using the regression technique. Elg^it 
model characteristics are examined in the e/aluatlon of the nodel. B/aluatlon 
is at the crop reporting district level, the state level and for the entire 
region. A ten year bootstrap test was the tasls of the statistical evaluation. 
The accuracy and current Indication of modeled yield r^iabllity could show 
improvement. There is ©?eat variability in the bias measured over the 
districts, but there is a slight overall positive bias. The model estimates for 
the east central crop reporting district In Minnesota are not accurate. The 
estimates of yield for 1974 were inaccurate for all of the models. 


Key words: Model evaluation, yield modeling, test criteria. 
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Evaluatijon of the Williams' Type 
Spring Wheat Mociel 
in North Dakota and Minnesota 

SUMMARY 

The Williams-type irodel is cterived from a stepwise regression approach usli^ 
yield for individual crop reporting districts as the (tependent variable conbined 
in the same nodel and rronthly v^ather variables and crop district specific soil 
texture and topography variables bs the Independent variables. Rnctions of the 
year surrogate variables, to account for technological changes, were also incor- 
porated as explanatory variables. The nocfel is objective, adequate, timely, 
simple and low in cost. Ihe relation between yield and the predictor variables 
is consistent with. scientific knowledge. The accuracy and current indication of 
modeled yield reliability could use improvement. There is a slight overall 
positive bias hit quite a lar^ge range of values over the CFDs. The nodel esti- 
mates for Minnesota CRD ^10 were not accurate. The yield estimate for 1974 was 
not accurate for any of the areas. 

Description of Model 


A nodel for analyzing the effects of weather and soil variables on 
Canadian spring wheat yields was described by Williams, et. al. (19751. The 
model falls mder the mneral classif inatlon of "'statistical - empirical 
regression nodels." The models for Canadian vheat, barley, and rye pooled 
crop district weather and agrononlc data to larger soil -color r^lons and 
incorporated soil texture and topographic info raiat ion along with trend and 
weather. 

A predictive yield model for spring vAieat in North Dakota and 
Minnesota, based on the concepts outlined by Williams, et. al., was devel- 
oped and tested by the Yield Model Development group. This Williams-type 
model incorporated CRD-level weather (nKonchly mean tonperature and total 
precipitation), soil texture, and topography in a ntinner as similar as 
posvSible to that used by Williams. The CRD-level data were pooled to the 
following two raore-or-less environmentally homogeneous regions: 

(a) Red River Valley consisting of ND CRD’s 30 & 60 and MN CRD's 10 & 40; 

(b) North Dakota remainder consisting of ND CRD's 10, 20, 40, 50, 70, 80 & 
90. 


Separate models vere developed for the two regions to provide predictions 
of CRD yields using individual CRD weather/soil data with coefficients fron the 
pooled model. Models were also developed for the two states, ND and MN, based 
on state-aggregated data for weather. 

Models were developed on the basis of data available, i.e., 1932 throu^ 
1979 for North Dakota and 1936 throu^ 1979 for Minnesota. The number of 
observations were similar for the two regions. The terms were selected fron 
stepwise regressions fron which the first ten (or fewer) terms entered by step- 
wise selection were retained for each region. A limit of 10 terms had been 


used by W'J.llams et. al., and seemed tx> be a reasonable upper limit here as well. 
Selected variables and the range of the coeffioioita are given in Appendix 2. 

Tlie basic variables vjhich differ slightly from those considered by Williams 
were: 

(1) monthly mean temperature; 

(2) total monthly precipitation; 

(3) percent of soils in the CRD in textural classes coarse, medium, and 
fine; 

(4) percQit of CRD area in the topographic classes level to gently 
undulating; 

(5) year as surrogate for technological, etc., trend. 

These basic inputs are used to calculate the possible model variables: 

Trend 1, linear between 1955 and 1966; 

Trend 2. linear bstwesi 1955 and 1978; 

TX => .75 {% fine soil) + .65 {% medium textured soil) -f .35 (56 coarse- 
textured soil); and were determined by scientist at Johnson Space 
Center through Buck Rogers, USDA; 

TXSQ “ TX squared; 

Tp = 56 of area level to gently undulating; 

■ TOP;^ ■ Tp squared; 

C ■ precipitation Sept. - Apr.; 

C squared; 


E5, E7 “ potential evapotransplratlon calculated by the 

Thomthwaite method (1948) for May PST5, June PBT6, J\ay PBI7 

E5, E6, E7 squared, i.e. PET5SQ, 

D6, D7* “ moisture deficits * E - preclp. for June, July; 

D5, D6, D7 squared, i.e., DEP6SQ, DEF7SQ; 

DEPSEA * seasonal deficit *D5 + D6 + D7-C: or potent ial evapotranspira- 
tion May through July minus the precipitation from September 
through July. 


DEPSEASQ =* DEESEAS squared; 

TXDS = (TX times DEFSEA) squared 

* D5 not used since D5, D6, D7. C and DEPSEAS are not all linearly 
independent. Of these, the stepwise regression selected 10 terms or less 
for each region. Variables E6, E7, D5 and C were not in Williairis' trodel. The 
cumulative precipitation was for the 21 months prior to planting. 

Ten years (1970-T9) were used for testing each model’s predictive per- 
formance In a manner similar to the way the models are applied in practice. All 
years following and including the t'^‘’/t year were not used in calculating the 
regression coefficioits. This was done for each successive test year. Appendix 
2 shows the terms included in each model and the range of coefficients as esti- 
mated from the I'' crlals. There are some general patterns but wide diversity in 
detail, reflecting both real and random region- to-reglon variations. "Growing 
conditions during these ten years are shown in Appendix 3. 

Only end-of-season models were tested, although "truncated" models 
providing yield estimates at the end of each month throu^out the growing 
season were developed. 

Variables selected included one trand for all models. The range on these 
coefficient estimates is shown in Appendix 2 variables selected are'also shown 
there. Variables in the state models differed from those In CRD models since 
texture variables were constant in state models. The estimates of the coef- 
ficients for the meteorological variables showed stability in thr ten year test 
period. 


EVALUATION METHODOLOGY 

Eight Model Characteristics to be Discussed 

The document. Crop Yield Model ‘Test and Evaluation Criteria , (Wilson, ^ 
al. , 1980 ), states: 

The model characteristics to be emphasized in the 
evaluation process are: 5 deld Indication re] xabllity, 

objectivity, consistency with scl^tlfic knowledge, 
adequacy, timeliness, mlnlrrajm costs, simplicity, and 
accurate current measures of modeled yield reliability. 

Each of these characteristics will be discussed with respect t to the Williams- 
type spring wheat model. 

Bootstrap Technique Used to Generate 
Indicators of Yield Reliability 

Indicators of yield reliability (reviewed below) require that the para- 
meters of the regression model be coroputed for a set of data and that a 
yield prediction be made based on that data for a given "test" year. The 
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values required to ^nerate Indicators of yield reliability Include the 
predicted yield, Y, the actual (reported) yield, Y, and the difference bet- 
ween them, d « Y-Y, for each test year. It is c3eslrable that the data 
used to generate the parameters for the model not Include data frctn the 
test year. 

In order to accomplish this, the "bootstrap" technique is used. Years 
from an earlier base period are used to fit the model and obtain a predic- 
tion equation. The values of the Independent variables for the test year 
immediately following the base period are Inserted Into the equation and a 
predicted yield is generated. Then, the base period is shifted one year 
forward and the process is cheated. CJontlming in this way, ten 
(1970-1979) predictions of yield are obtained, each independent of the data 
used to fit the model. Results are shown in Appendix 1 and growing conditions 
are Included in Appendix 4. 

The Y and d values for each year and for each CFD are obtained from 
models derived at this level. A Y and d value for the state yirid is 
derived from a state level mocfel. Another set of Y values are obtained at 
the state level by using a weighted average of the predicted yirids frcm 
bhe CRD models. Predicted yl^ds for the region are also obtained using a 
weighted average of the predicted yields fVom the CFID models and frcm the 
state models. The v^lghting factor used is harvested acreage for the year 
of the prediction. 

For North Dakota and Minnesota, data prior to 1969 ( 39 years) are used 
to fit prediction models for 1970, etc. The yield of all spring vdieat is 
used as the dependent variable, i.e., durum plus other spring Wheat. The 
average and percent production and the yiel.d over the ten year test period 
are listed in Table 1 for each ^ographic region. The percentage of 
regional production contributed by each CRD is shown graphically in Figure 
1. Darker shades indicate higher production. Historic yields are in Appendix 
5. 


Review of Indicators of Yield Reliability 

A 

The Y, Y and d values for the ten-year test period for each ^ographlc 
area may be suirraarized Into various indicators of yi^d rdLiability. 

A 

Indicators Based on the Differences between Y and Y (d) 

Demonstrate Accuracy, Precision and Bias 

Prom the d value, the mean square error (root and relative root rrean 
square error), the variance (standard cteviatlon and relative standard 
deviation), and the bias (its sqmre and the relative bias) are obtained. 

The rou mean square error (RMSE) and the standard deviation (SD) indl 
cate the accuracy and precision of the model and are expressed in the ori- 
ginal units of measure ( quintal sAiect are ) . It Ic about 68^ probable that 
the absolute value of d for a future year will be less than one RMSE and 
95/5 probable that it will be less than twice the RMSE. So, accurate pre- 
diction capability is Indicated by a small RMSE. 


A non-zero bias means the nocSel is, on the average, overestimating the 
yield (positive bias) or mderestlmating the yield (negative bias). Ihe SD 
is smaller than the RMSE vhen there is non-zero bias arid indicates what the 
RMSE vDuld be If there wre no bias. II* the bias is near zero, the SD and 
the RMSE will be close in value. Vte prefer an unbiased irodel, l.e., bias 
close to zero. 

Indicators Based on Relative Differences Between Y and Y (rd ) 

Demonstrate Vforst and Best Performance 

The relative difference, rd=(100d/Y), is an especially usefuD. indicator 
in years vhere a low actual yield is not predicted accurat^y. TViis is 
because years with small observed actual yields and lar^e differer ts often 
have the largest rd values. 

Several indicators are derived using relative differences. In order to 
calculate the proportion of years beyond a critical error limit, we count 
the number of years in vhich the absolute value of the relative difference 
exceeds the critical limit of 10 percent. Values between 5 and 25 percent 
were investigated and a critical limit of 10 percent was found most useful 
in describing model performance, lie worst and next to worst performances 
during the test period are defined as the largest and next to largest absolute 
value of the relative difference. The range of yield indication accuracy is 
defined by the largest and smallest absolute values of the relative difference. 

Indicators Based on Y and $ Demonstrate 
Correspondence Between Actual and Predicted Yiel ds 

Another set of indicators demonstrates the correspondence between actual and 
predicted yields. It would be desirable for Increases in actual yield to be 
accompanied by increases in predicted yields. It would also be desirable for 
large (small) actual yields to correspond to large (small) predicted yields. 

Two Indicators relate the change In direction of actual yl^ds to the 
corresponding change in predicted yields. Che looks at change fron the 
previous year (nine observations) and the other at change fron the average 
of the previous three years (seven observations). A base period of three 
years is used since a longer base period would further decrease the number 
of observations, vhlle a shorter period would not be very different from 
the comparison to a single previous year. 

Finally, the Pearson correlation coefficient, r, between the set of 
actual and predicted values for the test years is computed. It is 
desirable that r(-l <.+!) be large and positive. A negative r indi- 
cates smaller predict^ yields occurring with larger observed yi^ds (and 
vice versa). 
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AVERAGE PRODUCTION AND YIELD 
FOR TEST YEARS 1970-79 

SPRING wheat 

NORTH DAKOTA AND MINNESOTA 


STATE 

CRD 

PRODUCTION 

QUINTALS 

(1,000) 

BUSHELS 

PERCENT OF: I 

STATE REGION 1 

ONTL/HA^b 

D 

U/ACRE 

N. DAKOTA 

10 

10tB03 

39,693 

16,5 

12.3 

17,8 

26.5 


20 

6f9B5 

25,66A 


8.0 

17.1 

25.5 


30 

1A,255 

52,378 

21.7 

16,3 

20.7 

30.8 


AO 

' A,965 

1B,2A2 

7.6 

5.7 

16.7 

24,8 


50 

6,769 

24,873 

10.3 

7.7 

16.7 

24.8 


^0 

!:?ig 


12.6 

7.2 

9.5 

5.4- 

20.3 

16.4 

30.3 
24-, 3 


80 

3,123 

11,473 

4.8 

3.6 

13,1 

19.5 


90 

5,676 

20 , 855 

8.7 

6.5 

16.1 

23.9 

STATE 


65,611 

in 

O 


74.9 

17.7 

26.4 

1 

MINNESOTAIO I 

12,98A 

47,707 

59.0 

14,9 

23,7 

35,2 


20 

131 

480 

0.6 

0.1 

1 19.4 

28.8 


30 

A 

14 

0.0 

0.0 

1 17.9 

26.6 


40 

6,025 

22,136 

27.4 

6.9 

20.6 

30.6 


50 

1 ,231 

4v523 

5.6 

1.4- 

22.7 

33,7 


60 

A3 

158 

0.2 

0.0 

20,0 

29.7 


70 

660 

2,424 

3.0 

0.8 

21.9 

32,6 


80 

66A 

2,441 

3.0 

0.6 

24.2 

35.9 


90 

255 

936 

1.2 

0.3 

22.0 

32.7 

STATE 


21 ,996 

80,820 


25.1 

22.8 

1 

33.9 

REGION 


87,607 

321,894 



18.8 

27.9 
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Current Measure of Msdeled Yield Reliability OF POOR QUAU 

Defined by a Correlation Coefficient 

One of the irodel characteristics to be evaluated Is its ability to pro- 
vide an accurate, current nneasure of nodeled yield reliability. Although a 
specific statistic was not discussed in the paper, Crop Yield Model Itest 
and Evaluation Criteria (Wilson, i 1980), it was stated that: 

This ’reliability of the reliability’ characteristic 
can be evaluated by comparing model generated reliability 
measures with subsequently determined deviation between 
modeled and ’true' ^eld. 

.■Por regression nodels, this suggests the use of a correlation 
coefficient bt'tween two variables ^nerated for each test year. Che 
variable is ar. indicator of the precision with viilch a prediction for the 
next year can be made. It is based on the irodel development base period 
as s^plied to test year independent variable values. Tttie other variable 
(obtained retrospectively) is an indicator of how close the predicted 
value for the next year actually is to the "true” value. The estimate of 
the standard error of a predicted value fron the bas~ period irodel as 
applied to the test year is used for the first value, Sy, and the absolute 
value of the difference between the predicted and actual yield in the test 
year is used as the second variable, | d | . 

A non-parametric (Spearman) correlation coefficient, r, is anployed since 
the assumption of bivariate normality cannot be made. A positive value of 
r(-l r+ 1) indicates agreaient between Sy is associated with a small 
(larger) value | d | . An r value close to +l is desirable since it indicates 
that a small standard error pf prediction (and therefore a narrow con- 
fidence Interval about the predicted ^leld) is associated with small 
discrepancies between predicted and actual yields. If this vere the case, 
one V'jould have confidence in Sy as an indicator of the accuracy of Y. 

MODEL EVALUATION 

Indicators of Yield Reliability Based on Differences Between Y and Y (d) 

Show Wide Range In Bias and Root Mean Square Error 

The CRD, state and region values of Indicators of yield reliability 
based on d for this simple linear model are given in Table 2. The bias for 
CRDs is less than one quintal per hectare with the exception of the two 
Minnesota crop reporting districts and 80 in North Dakota. The CRDs 
have a relative bias of less than ten percent with the exception of the 
south central CRD in North Dakota and in Minnesota the northwest 
crop reporting districts. 

The root and relative root mean square error values (RMSE and RRMSE) 
are woi?se for CRDs in Minnesota and the Southern CRDs, Central and North Central 
CRDs In North Dakota. Values for RMSE range from 1.49 to 2.76 (Figure 2). 

Values for RFMSE range fron 8.5 percent to l8.3 percent. Generally, the bias 
is closer to zero but the RMSE in ND is larger for the aggregated CRD estima- 
tes than for the state estimates. 3h Mlnn^ota the state irodel is better in 
both reispects. The CRD irodel estimates aggregated to the regional level ha/e a 
similar RMSE and show more bias than the aggregated state nodel estimates. 
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table 2 

indi':ators of yield reliability 
ON D = predicted - ACTUAi.i YIELD 

WILLIAMS TYPE MODEL - SPRING WHEAT 
NORTH DAKOTA AND MINNESOTA 

MSE* VAR, B-SOR (OUINTAI S/HECTARE SQUARED) 
RMSE* SD» BIAS (QUINT ALS/HECTARE ) 
RRMSEt RSD» RB (PERCENT OF AVERAGE YIELD) 


STATE CRD 

MSE 

RMSE 

RRMSE 

VAR 

SD 

RSO 

1 B-SOR 

bias 

RB 

N, DAKOTA 10 

2,68 

a .64 

9.2 

2.16 

1.47 

8.6 

0.52 -0.72 

-4,0 

20 

4.01 

2.00 

11.7 

3,33 

1.83 

11.2 

0.67 -0.82 

-4^8 

30 

3.67 

1 .91 

9.3 

3.50 

1.B7 

9.2 

0,17 -0.41 

-2,0 

40 

2.22 

1.49 

8.9 

2.12 

1.45 

8.9 

0,10 -0.3? 

-1.9 

50 

5.90 

2.43 

14,6 

5.07 

2.25 

14.3 

0,83 -0.91 

-5.5 

60 

3.02 

1.74 

8.5 

2.20 

1.48 

7.6 

0.83 -0.91 

-4.5 

70 

2.93 

1.71 

10. S 

2.91 

1*71 

10.3 

0.02 

0,15 

0^9 

eo 

5.77 

2.40 

18.3 

I 2.16 

1 . 4.7 

9.8 

3.61 

1.90- 

14,5 

90 

4.11 

2.03 

12.6 

4.11 

2.03 

12,6 

0,00 

0.01 

0.1 

STATE MODEL: 
CRDS AG6R. 


1.S9 


1 

2.51 


9.0 

0.01 -0.09 

-0,5 

1.95 

1.40 

7.9 

1.82 

1.35 

7.8 

0.12 -0.35 

-2.0 

MINNESOTAIO 

8.52 

2.92 

12.3 

2.66 

1.63 

7.7 

5.86 -2.42 

-10,2 

40 

14,15 

3.76 

18.3 

11.81 

3.44 

18.1 

2.34 -1.53 

-7.4 

STATE MODEL- 

3.63 

1.90 

8.4 

3.09 

1.76 

7.5 

0.53 

0-73 

3.2 

CRDS AGGR. 

7.60 

2.76 

12.2 

3.11 

1.76 

3.6 

4.49 -2.12 

-9.4 

REGION 

CRDS AGGR. 

. 

2» 15 

1.47 

■ 7.9 

1.64 

1.28 

7, 1 

0.50 - 0.71 

-3.8 

STATES AGGR. 

2.07 

1.44 

7.7 

2,06 

1.44 

7.6 

0,01 

0.09 

0.5 
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TABLE 3 

INDICATORS OF YIELD RELIABILITY 
based on RD = 100 * ((PREDICTED-ACTUAL YI ELD) /ACTUAL YIELD) 

WILLIAMS TYPE MODEL - SPRING WHEAT 
NORTH DAKOTA AND MINNESOTA 



percent 






STATE CRD 

OF years 
IROI >10% 

largest irdi 

RD (YEAR) 

NEXT 

largest 

smallest 

IRDI 

RANGE 

IRDI 

N. DAKOTA 10 

30 




-1 .7 

16.2 

20 

-40 

23,3 

(1974) 

- 1 o , 2 

0.0 

23.3 

30 

30 

21.6 

(1974) 

-16,0 

-0,5 

21.1 

40 

30 

24.1 

(1974) 

-11.3 

0.0 

24.1 

50 

40 

32,5 

(1974) 

-24.4 

-2.2 

30,3 

60 

30 

-13.7 

(1979) 

-13.5 

•2.2 

11.5 

70 

50 

-15.7 

(1973) 

12.8 

3.9 

1 1 .a 

80 

70 

47.1 

(1974) 

28.2 

5,3 

41.3 

90 

40 

21.7 

(1974) 

-19.5 

-4.2 

17.5 

STATE MODEL 

30 

23,4 

(1974) 

-11.4- 

0.5 

22.9 

CRDS AGGR. 

20 

17.5 

(1974) 

-13.1 

“1.3 

16.3 

MINNESOTAi 0 

50 

1 ^ -■ 
- JM3 • r 

# ^ r\ ^ k 

^ 1 ^ f 1 ^ 

- J, => • l; 

r~ 

U • D 

16,2 

40 

50 

-29,7 

(1977) 

-24,3 

-2.7 

27.0 

STATE MODEL- 
CRDS AGGR, 

20 

40 

12,8 

-18.3 

(1978) 

(1973) 

10.0 

-18,0 

-0.5 

}?:} 

REGION 

CRDS AGGR. 

30 

-13.2 

(1971) 

12.2 

-1.2 

11.9 

STATES AGGR. 

30 

19,5 

(1974) 

-10.5 

0.0 

19.5 


U'. 







Figure 5. Next largest absolute value of the relative difference for Spring Wheat during the test years 
1970-79. Darker shades indicate CRDs with high production. 
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Indicators of Yield Reliability Based on Relative Dlfferenoes Between 
Y and Y (rd) Show 197^ as Vforst Year and 20-70 Percent 
of the Years have rd Greater than 10 Percent 


The CRD, state and region values for Indicators of yield reliability based 
on rd are given In Table 3. CFD values are shown In Figures 3-5. IVo to six of 
the ten test years have absolute relative differences gceater than 10 percent In 
most (10 out of 11) of the CRDs. Failure In predicting very low yield In 197^ 
caused the largest absolute relative difference for nost CRD’s. The largest 
absolute relative difference ranged frcxn 16.7 percent to 47.1 percent and next 
largest from 11.0 to 28.2 percent. The smallest absolute relative difference is 
sometimes zero (two CRDs) and ranged up to 5.3 percent. 

As compared to the aggregated CRD results, the state nodel values for the 
largest absolute relative differences are • somewhat lower in Minnesota but much 
larger In North Dalcota. There are similar number of years with absolute rela- 
tive differences greater than 10 percent with the aggregation of CRDs and of 
states to regional level. 

A 

Indicators of Yield Reliability Based on Y and Y Show Correct Direction 
of Change Over Half the Time In Comparing Predicted to 

Actual Yields 


Plots of the actual and predicted yields over the ten-year test period 
using state level irodels are displayed In Figures 6 and 7. Estimates have 
little bias in ND. 'Gie estimates for Minnesota are better in later year. The 
CRD, state and region values for indicators of yield reliability based directly 
on actual and predicted yields are given In Table 4. 

In all the CRDs the change in direction of predicted yields agrees 
with the change In direction of actual yields from the previous year in over 
half of the test years (Figure 8). ’v^en the direction of change is frcm the 
average of the three p?evlous years, the direction of change is again In 
agreement over half the time In all CRDs (Figure 9) . Results for the state are 
mixed. Far comparison with the previous year the ND state nodel is not as @Dod 
as the aggregated CRDs, but the two methods are similar viien comparing to base 
period. CRDs aggregated are not as gDod as state model but are similar to the 
state models aggregated to the region. The Pearson r (Figure 10) is positive 
for all the CRDs. The range of the positive r's is 0.62 to 0.90. State results 

are worse and regional CRD's aggregated results are better. This lndica/>es that 

tne model will give the correct direction of change over half the time. Chly 

the final yield estimate was tested, thus change of predicted yield frcm pre- 

vious forecasts within the current year were not investigated. 


Base Period Indicates More Precision Than 
Independent Tests Can Confirm 


Certain statistics generated fran the r^resslon analysis of the base period 
data are often used to provide some indication of expected yield reliability. 
However, these statistics only reflect how well the model describes the data 
used to generate the model, i.e., fit of the model, rather than how well the 
inodel can predict from Independent data. Therefore, it is Important to compare 
these indicators of fit of the model to the independent indicators of yield 
reliability discussed In the preceding sections. In this way, one can see how 
these base period Indicators of fit of the model do or do not correspond to inde- 
pendent test indicators of yield reliability. 
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FIGURE 7 
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NORTH DAKOTA AND MINNESOTA 



PERCENT OF YEARS 



DIRECTION OF CHANGE IS CORRECT 

PEARSON 

STATE CRD 

FROM PREVIOUS YEAR 

from BASE PERIOD 

CORR. COEF. 

N, DAKOTA 10 

78 

71 

0,79 

20 

56 


0,67 

30 

67 

71 

0,62 

AO 

89 


0,83 

50 

56 

Ji 

0,60 

60 

89 

57 

0^82 

70 

67 

57 

0,66 

60 

78 

86 

0.84 

90 

67 

36 

0,64 

STATE MODEL 

67 

71 

0,67 

CRDS AGGR, 

89 

71 

0.77 

MINNESOTA! 0 

67 

100 

0.90 

40 

73 

AA 

ikr w 

A TT 

V • * r 

STATE MODEL 

78 

57 

0.75 

CRDS AGGR. 

44 

66 

0,83 

REGION 




CRDS AGGR. 

78 

86 

0.79 

STATES AGGR. 

78 

86 

0.70 


Figure B. Percent of test years (1970-79) the direction of change in predicted yield from the previous 
year agrees with the direction of change in actual .Spring Wheat yield. Darker shades indicdle 
CRDs with higher production. 










Figure lu. Pearson correlation coefficient between 
years .{1970-79) . Darker shades indicate 
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table 5 

residual mean square as_an 


indicator of the fit of the model 
based on the model development base period 


williams type model - spring wheat 

north DAKOTA AND MINNESOTA 


STATE CRD 


BASE PERIOD 
RESIDUAL mean SQUARE 
LOW HIGH AVERAGE 


INDEPENDENT 

TEST 

MSE' 


N. DAKOTA 10 
20 


STATE MODEL 


MTNNE^^OTAI 0 
AO 

STATE MODEL 


A. 72 
A. 72 
A . 65 
A, 72 
A.72 
A. 65 
A. 72 
A. 72 
A. 72 


A. 65 
A»65 


A, 98 
A*90 
5.07 
A. 98 
A. 98 
5*07 
A. 98 
A, 98 
A. 98 


5.07 

5.07 


A.88 
A • 88 
A. 83 
A.88 
A.88 
A . 83 
A. 80 
A. 86 
4 e 86 


3.16 3.A9 3.36 


A. 8*3 
A. 63 


3.27 3.50 3.37 


2.68 
A. 01 
3.67 
2.22 
5.90 
3.02 
2.93 
5.77 
A. 11 

2.52 


8.52 
iA. It) 

3.63 


table 6 

CORRELATION BETWEEN OBSERVED AND PREDICTED YIELDS AS AN 
INDICATOR OF THE FIT OF THE MODEL 
BASED ON THE MODEL DEVELOPMENT BASE PERIOD 


williams TYPE model - SPRING WHEAT 
NORTH DAKOTA AND MINNESOTA 


TEST 

STATE CRD 


BASE PERIOD 

correlation COEF, 

LOW HIGH average 


INDEPENDENT 
CORR. COEF. 


AKOTA 10 
20 


TE MODEL' 


NIESOTAIO 

AO 


0.88 

0.08 

0.89 

0.08 

0,08 

0.39 

0.86 

0.88 

0.68 


0.91 

0.91 

0.92 

0.91 

0.92 

0.91 

0.91 


0.92 0.9A 


0.09 

0,89 


0.92 

0.92 


0.90 

0.90 

0,91 

0.90 

0.90 

0.91 

0-20 

0.90 

0.90 

0.93 


0.91 

0.9i 


0.90 0.9A 0.93 


0,79 

0.67 

0,83 

0,60 

0,02 

0,66 

0.8A 

0.6A 

0,67 


0.90 

0.77 

0.75 


TE MODEL' 


Otie Indloatoi' of ylGl4 r*elial>lUt$y, tho mm aquaro oppor (MSE), la tho aym 
of aquapQd d valuea (d » Y»Y) for fel>o Ijadopondant teafe dlvidod by eUo 
n.u»ibop of yaai's (Table 2). Tie diroots analogu© fbp bhe iiodal ^tevelopnenfe 

baao pa Plod la the peaidual mm aqvapo. Tio poaidual iman aquapo la obtained 
by flpat pnopatlng febo uaual loaat aquapoa pi'odlotlon otiuation ualng the baao 
poplod yeapa, Tien liiafeaad of p^ediofeing tVio yield tbp the fbllo\4i^ teat yeap» 
yields ape iipedleted tbp eooh of the baae period yeara* Tie peaMual iman 
aquapo la tiie auin of aquaiMid d viduea fbp these baao period yearo divided by the 
apppopplato dagpoea of fpeedom (nunibep of yeapa mlnna nunbop of papaaotera eatl- 
mated In fitting the nodel), toi'oaa one value of ^SB la gsnemtod fbp eaoh 
geographlo area o/op ^le entire teat period, a value of the residual nean aqinro 
la ^aerated £bp aaoh baao period eopreapondlng to a teat ye/op In tliat area. 

Tlie low, high, and average of the baae period values fbr saoi-j area are given In 
Table 5. Valuoa fbr ORD’a in pooled regions are the aai>e. 

Tie ^iSE values 'In Table 2 are alao given In Table §, Tie average peaddual 
mean aquai'o fi'om tiie fit of tlie cxjuation la loaa tiian the ^t3E, exoept ibr OFOa 
in Mhvieaota and ts'jo In North Dal®ta* ^i foot, the awalleat residual iman 
squai'o la no re than tiie ^tSE in all exoept tlioae fbur. Mhmeaota 01^ to la the 
outlier \'boae Independent teat MSE la muah larger than the lai^at realdual iman 
aquai'Q ft'<sn the baao period. 

Another Indloator of yield reliability la the oorrelatlon ooefflelent, r, 
betwoen the obaetved and predloted yields fbr the independent yoara (Table 
t). It la dealrable fbr r ba te oloae be +1, c?vQn ttougii It ean be negative. 

The analogue tbr the jiodel developmetit baao period ia the aqmi'o root of R^, the 

QoefflQlent of lulLti^Ie deteniilnatlon. Tie square I'oot of 1^ expressed as a 
proportion, R (0^,R<fel), may be Inteiqiroted as the eort^elatlon bet\>reen observed 
and predloted values fbr tlie base period yeara. Tie low, high and overage 
values of R fbr eaoh geographlo area are ^ven in Table o. Values fbr CFD’a In 
the same pooled region m^e the sonve. 

Tie Poaraon eorrelatlon eoef fiotent values in Table 4 are also given In 
Table 6, Tie hlgheat paltlve value of r la 0,84 and one r value la ,60, 

Average CRD values of R are from 0,90 bo 0,91. Tie valrea of r fran the Ijide- 
pendent teats are eortaiiily mush lower than the values of r from the base 

period. Xt la obvlouo tliat levels of R (or alternatively R^) for a nodal deve- 

lopnent base period ai'o of no value in Indleatlng Independent porfoniranee of 
tills jiodel, III fbot, tlie base period R or R® oan be very misleading aa la the 
ease with Minnesota 01® 40, 


Model Is Qb.leetlve 


Slnee the independent variables are objectively defined no subjective 
Inputs vore t^iulred to i\a\ the nodel. 

Results <Tffer If the set of years used to generate the models r«5re 
changed. Different Independent variables might {»sslbly ha/e been selected \-dth 
a dilfferejit time period. Cnee the decisions m the tinre period to use fbr modal 
development and the varl^lea to be used In the r^reasdon are fixed, the opera- 
tion becomes completely objective. Tie variables to estimate the time tret^is 
and soil texture required subjective deciaiona. 
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Model Oonaldera Kfiom Solentlflo Relaticnahlps 

The no dels oonalder faotora vftiloh htwe a atatiatJoally algn If leant rela- 
tlsnahtp with crop yield. Some Icnown n^atlenslUpa between v^ather and crop 
yield may be laoking in the mo^la beoauae the baae period did not oontain 
avldenoe of this relationship or the weather variables v^sre not ibnnulated to 
detect the relatlonahlp, Non-ollmatio, teohnologioal causes of yield variation 
are not included even thougli it is known t 4t av»h relationahlpa exist. Trei^d 
ia a problem since changes are Impossible to detect from year to year as being 
caused by the components of trend. Soil variables for the state nodel are 
nearly constant tl’irou^i tlie years and are therefore of questionable value. 

Model is Adequate 

Tlie model can provide estimates fbr any geograplilo area and soils 
having historic yi^d and iionthly tanperatur© and precipitation 
infomatlon. This basic information would be required fbr any nodaling 
©ffbrt, Modsle vould hove t» be redeveloped fbr specif lo areas. 

Model 1s Timely 

As soon as reliable figures are available fbr nonthly tenperature and 
precipitation througli tlie growing season iioctela can be developed fbr estlr- 
matlng tlie current yield, ’’Ebd-of-season" moctels can provide yield estimates 
as soon as V'leather data fbr tlie final required month are available. 

Model is Not Costly 

The only data required are the historic nonthly tanperature and preci- 
pitation md actual yield. Tliese data are really available, The least 
squares regression model can be fit using any standard statlstloal pacltage 
program. Estiinatea fbr tlie current 5 /ear raiulre the nontlily tanperature and 
precipitation data and (drived variables soon jif ter the end of the nonth. 

Soils data are required fbr pooling CRD's but not fbr state models. 

Model is Simple 

Tlie nodel is simplo. Users can clearly underatand the basis of pre- 
dicted yields. The nodel 1s easy to use. Tlie Independent variable values 
in the nodal are simply fmotlona of the yoar, predeteniULned texture and 
topological variables, and transfOraiatlons of the nontlily tonperature and 
precipitation. Tb estimate the yield fbr a current year one v-jould need 
complete information on the transfbmiatlons used to derive tlie wather 
variables and the pre-detemined variables. 

Model has Fbor Current Measure of Modeled Yield Reliability 

Hie CRD, state and region values fbr the Speannart correlation coef- 
ficient between the estimate of tlie standard error of a predicted yi^d 
value and the absolute value of the difference between the predicted and 
actual yield are computed. They are given in Table 7 and slx»wn hi Figure 
11. In 7 of 11 GRDs, the correlation ia negative. The largest positive 
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value is 0.39. Thus, the noctel ctoes not provide a ®3od measure as to how 
close the predicted values will be to the actual values. Instances of jfears 
with smaller (larger) confidence intervale about the true predicted value 
are all too often associated with larger observed discrepancies between the 
actual and predicted values. The accuracy of a predicted yield cannot be 
reliably Judged using Infonnatlon provided by the model. The state model 
in North Dakota is better than the individual CRDs. None of the indicators 
for CRDs or for the state in Minnesota are gsod. The value of the standard 
error of a predicted yield is a function of the residual mean square and the 
distance of the independent variable values in the prediction j/ear from 
their average during the base period. 

CONCLUSIONS 

Williams-type spring vheat models for North Dakota and Minnesota utilize 
monthly temperature and precipitation, predetennined texture and topography 
variables, and piecewise linear trend to estimate yield. Indicators of yi^d 
reliability obtained from a ten jrear bootstrap) test are examined to determine 
strengths and wealmesses of the models. The bias and root mean square error 
show quite a range over the various CFDs, but the overall bias in Minnesota is 
negative, i.e., the models tend to under estimate the actual yield. Minnesota 
CRDs qnd several in North Dakota have 

a very high root mean square error. The 1974 spring mieat yield was 
the most difficult for the models to estimate. The direction of change was 
correct but the magnitude wafj underestimated. Absolute r^ative differences 
were greater than 10 percent anyvhere from 2 to 7 times during the 10 year test 
period. The models showed some capability in indicating the direction of change 
in yield from the previous ymrs and also from a base period. Precision indi- 
cated by the r 2 value and the residual mean square errors does not agree with 
model performance for the independent 10 year bootstrap test. 

The biggest wealcness seems bo be with the Minnesota CRD estimates. Models 
are objective, adequate, timely, simple and not costiLy. It considers some known 
scientific relationships. 
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TABI E 
CURRENT INDICATION 


modeled yield 


_ _ OF 

RELIABILITY 


AGREEMENT, BETWEEN BASE PERIOD PREDICTED 
AND TEST YEAR ACTUAL ACCURACY 

williams type model - SPRING WHEAT 
NORTH DAKOTA AND MINNESOTA 


STATE CRD 

spearman 

CORRELATION COEF, 

N. DAKOTA 10 

-0.04 

20 

-0.38 

30 

0.39 

40 

-0.01 

50 

-0.07 

60 

-0.01 

70 

0,05 

80 

0.02 

90 

0.22 

STATE MODEL 

0.10 

MINNESOTAIO 

-0.50 

40 

-0.11 

STATE MODEL 

-0.73 


Figure 11. Spearman correlation coefficient between the estimate of the standard error of a predicted 
value from the base period nwdel and the absolute value .ne difference between the pre- 
dicted and actual *ipring(^ieat yield in the test years (1970-79). Darker shades indicate 
CRDs with higher production. 
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APPEND T X I 

BOOTSTRAP TEST RESULTS 
FOR spring wheat YIELDS IN 
NORTH DAKOTA AND MINNESOTA 
USING A WILLIAMS TYPE MODEL 


CRD 

YEAR 

YIELD 

ACTUAL 

(O/H) 

PRED. 

D 

RD 

S.E. 

PRED. 

10 

1970 

16.2 

15.5 

-0,7 

-4,3 

2.29 


1971 

20.0 

17.8 

-2.2 

-11.0 

2.26 


1972 

19.9 

21.2 

1 .3 

6.5 

2.30 


1973 

20.1 

16.5 

-3.6 

-17.9 

2.25 


1:974 

14.8 

15.6 

0.8 

5.4 

2.26 


1975 

16.7 

16.2 

-0.5 

-3.0 

2,27 


1976 

17.6 

17.3 

— 0 . 3 

-1,7 

2.24 


1977 

16.5 

15.9 

-0,6 

-3.6 

2.25 


1978 

21 .9 

19.7 

-2.2 

-10.0 

?.22 


1979 

14.5 

15.3 

0.8 

5.5 

2.21 

20 

1970 

14.9 

14.5 

-0,4 

-2.7 

2,27 


1971 

20.7 


-3.2 

-15.5 

2.25 


1972 

19.2 

19.2 

0.0 

0.0 

2,26 


1973 

19.8 

16.6 

-3.2 

-16.2 

2,24 


1974 

12.9 

15.9 

3.0 

23.3 

2.25 


1975 

16.4 

15.0 

-1 .4 

-8,5 

2.26 


1976 

16.4 

16.4 

0.0 

0.0 

2.23 


^ ■> *7 

1 *7 / f 

1 4 . S 

15.7 

0.9 

6 • 1 

2.25 


1978 

19.7 

17.9 

-1.8 

-9.1 

2.20 


1979 

16.6 

14.5 

-2.1 

-12.7 

2.20 

30 

1970 

18.9 

18.0 

-0.9 

-4,3 

2.27 


1971 

24.1 

22.1 

-2.0 

-8.3 

2.24 


1972 

21.0 

22.2 

1.2 

5.7 

2.29 


1973 

20.4 

20.6 

0.2 

1 . 0 

2.22 


1974 

15.3 

18.6 

3,3 

21.6 

2.29 


1975 

20.9 

18.7 

-2.2 

-10,5 

2.25 


1976 

19.9 

19,8 

-0,1 

-0,5 

2.23 


1977 

20.3 

20.7 

0.4 

2.0 

2.30 


1978 

22.3 

22.1 

"0.2 

-0.9 

2.30 


1979 

23.8 

20.0 

-3.8 

“16.6 

2.30 

AO 

1970 

14.2 

15.5 

1.3 

9,2 

2.28 


1971 

18.6 

16.5 

-2. 1 

-11.3 

2.24 


1972 

20.2 

20.4 

0.2 

1.0 

2.29 


1973 

17.7 

15.7 

-2.0 

-11.3 

2.24 


1974 

1 1.6 

14.4 

2.8 

24.1 

2.25 


1975 

16.5 

15.8 

-0.7 

-4.2 

2.26 


1976 

17.3 

15.6 

-1.7 

-9,8 

2,23 


1977 

15.4 

15.4 

0,0 

0.0 

2.24 


1978 

20.1 

19.2 

-0.9 

-4.5 

2,21 


1979 

15.2 

15.1 

-0.1 

-0.7 

2.19 
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APPENDIX / 

^ BOOTSTPAP TEST RESULTS 
FOR^SPRING WHEAT YIELDS IN 
north DAKOTA AND MINNESOTA 
USING A williams TYPE MODEL 


CRD YEAR ACTUAL 


D/H) 

>RED. 

D 

RD 

S • E • 
PRED. 

13.7 

-2.2 

-13.3 

2.27 

17,0 

-5.5 

-24. A 

2.25 

17.8 

— 0.4 

-2.2 

2.27 

14.4 

-0.6 

-4,0 

2.25 


3,9 

32.5 

2.26 

15.9 

-1.2 

-7.0 

2,26 

14.0 

-0.7 

-4.3 

2. "^4 

15.2 

0.8 

5,6 

2,25 

18.1 

-1.1 

-5,7 

2,20 

15.8 

-2.1 

-11.7 

2.20 

17.6 

-0.4 

-2.2 

2.29 


-3.3 

-13.5 

2.23 

21.6 

1.0 

4.9 

2,27 

19.3 

-0.9 

-4 . 5 

2.22 

17.4 

1.7 

10.3 

2.32 

18.6 

-0,8 

-4.1 

2,26 

18.3 

-1.0 

. ? 

« w 

2.24 

20.0 

-0.6 

-2.9 

2,30 

21.1 

-1.7 

-7.5 

2.30 

19.5 

-3.1 

-13.7 

2.30 

15.4 

1.6 

11.6 

2.28 

17.5 

-1 . 1 

— 5.9 

2.26 

21.1 

2.4 

12.3 

2.31 

16.1 

-3.0 

-15.7 

2.25 

14.2 

-1.0 

-6,6 

2.27 

16.0 

0.6 

3.9 

2.27 

14.9 

-1.9 

-11.3 

2.24 

15.2 

1.1 

7.8 . 

2.25 

19.8 

2.0 

U.2 

2.23 

14.9 

0.3 

5.7 

2.21 

13.4 

2.3 

20.7 

2,28 

16.3 

-1.5 

— 8,4 

2.27 

18.4 

2.4 

15.0 

2.29 

13.9 

0.7 

5,3 

2.26 

12.8 

4.1 

47. 1 

2,27 

15.3 

1.1 

7.7 

2.27 

13.1 

2.0 

18,0 

2.25 

14.1 

3.1 

28.2 

2.25 

18.6 

3.0 

19.2 

2.23 

14.0 

1.8 

14,8 

2.21 


50 


60 


70 


BO 


1970 

1971 

1972 

1973 
197A 

1975 

1976 

1977 

1978 

1979 


1970 

1971 

1972 

1973 

1974 

1975 

1976 

1977 

1978 

1979 


1970 

1971 

1972 

1973 

1974 

1975 

1976 

1977 

1978 

1979 


1970 

1971 

1972 

1973 

1974 

1975 

1976 

1977 

1978 

1979 


15.9 
22.5 
18.2 

15.0 

12.0 

17. 1 
14.7 
14.4 

19.2 

17.9 


16.0 

24.5 

20.6 
20.2 

15.7 
19.4 

1 cj “s 

A 7 ' . 

20.6 

22.8 
22,6 


13.8 

18.6 

18.7 

19.1 

15.2 
15.4 

16.8 
14.1 
17.8 
14.1 


11.1 

17.8 

16.0 

13.2 
8.7 

14.2 
11.1 
11.0 
15.6 

12.2 



APPENDIX * 

BOOTSTRAP TEST RESULTS 
F*OR SPRING WHEAT YIELDS IN 
NORTH DAKOTA AND MINNESOTA 
USING A WILLIAMS TYPE MODEL 


STATE CRD 

YEAR 

YIELD 

ACTUAL 

lO/H) 

PRED, 

N. DAKOTA 90- 

) 970 

14,3 

13.7 


1971 

21.5 

17.3 


1972 

17,3 

19.0 


1973 

15.9 

13.9 


197A 

12.9 

15.7 


1975 

15.3 

16.8 


1976 

11.9 

12.6 


1977 

17.1 

16. 1 


1978 

17.3 

19.3 


1979 

17.3 

16.5 

STATE MODEL 

1970 

15,8 

16.3 


1971 

21 .4 

19.0 


1972 

1 o /. 

on o 


1973 

ibIs 

16l4 


197A 

13.7 

16.9 


1975 

17.4 

16,7 


1976 

16.6 

16,1 


1977 

16.7 

17.3 


1978 

20.1 

20.2 


1979 

17.7 

16.6 

CRDS AGGR. 

1970 

15.8 

15.6 


1971 

21.4 

18.6 


1972 

19.4 

20.4 


1973 

18.5 

16.9 


197A 

13.7 

16.1 


1975 

17.4 

16.7 


1976 

16.6 

16.3 


1977 

16.7 

17.0 


1978 

20.1 

19.7 


1979 

17.7 

16.5 


0 

RD 

s . e . 

PPEO. 

-0 • 6 

-4.2 

2.27 

—4 • 2 

-19.5 

2.23 

1 .7 


2.27 

- 2.0 

- 12.6 

2.24 

2.8 

21.7 

2.27 

1 .5 

9.B 

2.29 

0,7 

5.9 

2.24 

- 1,0 

-5, B 

2.24 

2.0 

11.6 

2.22 

- 0.8 

-4.6 

2.19 

0.5 

3.2 

2.11 

-2.4 
1 c 


2,03 

P A Q 

- 2,1 

-iiI4 

1 l99 

3.2 

23,4 

2.06 

-0.7 

-4.0 

2.02 

-0.5 

-3.0 

1.95 

0.6 

3.6 

2.09 

0.1 

0.5 

1.97 

- 1.1 

-6.2 

1.89 

- 0.2 

-1.3 


- 2.8 

”13. 1 


1.0 

5.2 


- 1.6 

-8,5 


2.4 

17.5 


-0.7 

-4,0 


-0.3 

-1 .B 


0.3 

1.8 


-0.4 

- 2.0 


- 1.2 

-6.B 
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APPENDIX 1 

, BOOTSTRAP TEST RESULTS 
FOR SPRING WHEAT YIELDS IN 
NORTH DAKOTA AND MINNESOTA 
USING A williams TYPE MODEL 

YIELD (0/H) 

YEAR ACTUAL PRED. D 


RD 


S.E. 

PRED. 


1970 

18.5 

18.7 

1971 

26.9 

22,4 

1972 

24.2 

23.3 

1973 

26.0 

22.1 

1974 

18.6 

18,7 

1975 

22.7 

20.6 

1976 

24.6 

21 . 1 

1977 

23.6 

21.4 

1978 

26.6 

22.9 

1979 

24.9 

21.2 

1970 

18.4 

17.9 

1971 

23.3 

20.2 

1972 

17,3 

18.6 

1973 

26.7 

20.2 

1974 

19.4 

18.4 

1975 

18.2 

18.7 

1976 

14.9 

16.9 

1977 

28.6 

20.1 

1978 

17,3 

19,8 

1979 

21.6 

19.6 

1970 

1971 


^3ll 

1972 

22.2 

23.7 

1973 

26.2 

24.7 

1974 

19.5 

21.2 

1975 

20.9 

23.0 

1976 

21.8 

23.5 

1977 

26.8 

24.8 

1978 

22.7 

25.6 

1979 

23.6 

25.9 

1970 

18.5 

18,4 

1971 

25.9 

21,8 

1972 

22.3 

22.0 

1973 

26.3 

21.5 

1974 

18.9 

18.6 

1975 

20.9 

19.9 

1976 

20.9 

19.5 

1977 

25.5 

20.9 

1978 

23.3 

21.8 

1979 

23.8 

20.7 


0.2 

1.1 

2,29 

-4,5 

-16. 7 

2.25 

•”0,9 

-3,7 

2.29 

-3.9 

-15.0 

2.22 

0.1 

0 . 5 

2,32 


-9,3 

2,27 

-3.5 

-14.2 

2.25 

-2.2 

-9.3 

2.32 

-3.7 

-13,9 

2.31 

-3.7 

-14,9 

2.31 

-0.5 

-2.7 

2.27 

-3.1 

-13.3 

2.27 

1.3 

7,5 

2.4? 

-6.5 

-24.3 

2.23 

-1.0 

-5.2 

2,31 

0.5 

2.7 

2,20 

2.0 

13,4 

2.29 

-8.5 

-29,7 

2,31 

2.5 

14.5 

2.3? 

-2.0 

-9.3 

2.30 

-1.9 

-7,4 

l:fi 


6.3 

2.1? 

-1.5 

-5,7 

2. 1 1 

1.7 

6.7 

2.15 

2.1 

10.0 

2.06 

1.7 

7.8 

2.03 

-2,0 

-7,5 

2.04 

2.9 

12.8 

2.00 

2.3 

9.7 

1.97 

-0.1 

-0,5 


-4.1 

-15.8 


-0.3 

-1.3 


-4,8 

-18.3 


-0.3 

-1,6 


-1.0 

-4,0 


-1.4 

-6.7 


-4,6 

-18.0 


-1.5 

-6.4 


-3.1 

”13.0 
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APPENDIX I 

^ bootstrap test results 

FOR, spring wheat YIELDS IN 
NORTH DAKOTA AND MINNESOTA 
USING A williams TYPE MODEL 


STATE 

CRD 

YEAR 

YIELD 

ACTUAL 

(0/H) 

PRED. 

0 

RD 

RFGION 







CRDS 

AG6R. 


16.1 

15.9 

-0.2 

“i . 2 



1971 

22.0 

19.1 

-2.9 

-13.2 



1972 

19.9 

20.6 

0.7 

3.5 



1973 

19.9 

17.7 

2.2 

-11.1 



Lilii 

14.7 

16.5 

: .8 

12.2 



1975 

18.1 

17,3 

— 0.8 

— 4,4 



1976 

17.5 

17.0 

-0.5 

-2.9 



1977 

18.7 

17.9 

-0.8 

-4,3 



1978 

20.7 

20.1 

-0.6 

-2.9 



1979 

18.9 

17,3 

-1.6 

-8.5 

STATES 

AGGR • 

1R70 

16.2 

16.6 

0.4 

2,5 



1971 

22.0 

19.7 

-2.3 

-10.5 



I'i f t 

19. V 

21 .4 

1.5 

7.5 



1973 

19.9 

17.9 

-2.0 

— 1 0 . i 



1974 

14.9 

17.8 

2.9 

19,5 



1975 

18.2 

18.1 

-0.1 

“0,5 



1976 

17.9 

. 18,0 

0.1 

0.6 



1977 

19.3 

19.3 

0.0 

0.0 



1978 

20.7 

21 .4 

0.7 

3.4 



1979 

13.9 

18.6 

-0.3 

-1.5 


S.E 

PRED 
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APPENDIX 4 


Year 


1970 


1971 


1972 


1973 


Brief DescripCion of Crowing Conditions for 
Spring Wheat in Bootstrap Test Years 


North Dakota 


Minnesota 


Yield down 21%-production down 
25%. Lowest yield since 1967, . 
production since 1966. 

Wet early spring-planting delayed. 
Central and West areas dry out in 
July-moisture stress and slow 
growth. 

Nitrogen rate/acre up 3^%. 


Yield up 34Hl%-production up 87%. 

Record yield and production- 
highest harvested area since 
1953. 

Early planting. 

Moisture and teni’^erature ade- 
quate through July. 

Early harvest after fine growing 
conditions. 

Nitrogen rate/acre up 23%. 

Yield down 94%-production down 
26%. 

Wet early spring-planting delayed. 

Dry June-mid July, especially 
Eastern two-thirds of state. 

Harvest on normal schedule. 

Nitrogen race/acre up 2%. 

Yield down 4H%-production up 1152%. 

Dry spring-early planting. 

Much rain in June-early July but 
South remains dry. 

Harvest early. 

Nitrogen rate/acre up 24%. 


Yield down 8%-lowest yield and pro- 
duction since 1966. 

Cold, wet spring-planting delayed. 

Cold and moisture high through 
June-hot July hurts crop. 

Leaf rust loss 1.9 bu/acre (all 
wheat) . 

Nitrogen rate/acre up 12%. 

Dominant variety is Chris. Era 
released as new variety. 

Yield up 38%-harvested area up 87%. 

Record yield, harvested area and 
production. 

Early planting. 

Moisture good through July; cold 
July. Moisture short by mid 
August . 

Excellent harvest conditions. 

Nitrogen rate/acre down 35%. 

Yield down 13%. 

Wet spring-planting delayed. 

Moisture short in North by mid 
July. 

Heavy rains /flood in Central dur- 
ing July. 

Cold wet August delays harvest. 

Nitrogen rate/acre up 243%. 

Yield up 18%-record yield, har- 
vested area and production. 
Harvested area up 236% from 1970. 

Cool, dry spring-early planting. 

Moisture very good through June. 

July drier. 

Harvest normal. 

Nitrogen rate/acre down 7%. 

Era accounts for 41% and Chris 12% 
of area. 


APPENDIX 4 


Year 


1974 


1975 


1976 


1977 


Brief Description of Growing Conditions for 
Spring Wheat in Bootstrap Test Years 


North Dakota 


Minnesota 


Yield down 22%-lowest since 1961. 

Production down 13%- lowest since 
1970. 

Largest harvested area since 
1951. 

Excess spring moisture -late 
planting. 

Late June-July very dry (1/3 
normal precipitation) and hot. 

Harvest late. 

Nitrogen rate/acre down 8%. 

Dominant variety is Waldon (52%). 
Olef introduced with 4.2% of 
area. 

Yield up 2 7^%-p reduction up 26%. 

Late, wet spring-planting de- 
layed. 

Heavy June rains- flooding in South 
Red River Valley. 

Hot, dry July. 

Nitrogen rate/acre up 19%. 

Olaf accounts for 18% of planted 
area. 

Yield down 5%. 

Record harvested rea. 

Moisture favorable at planting. 

Hot, dry through August. 

Early harvest. 

Nitrogen rate/acre up 29%. 


Yield up 1%-production down 20%. 
Low spring moisture. 

Drought in South and Central. 

Hot temperature and dry winds in 
late July-September . 

Early harvest-heavy rains cause 
sprouting damage. 

Nitrogen rate/acre up 2%. 


Yield down 26%-lowest since 1970. 

Record harvested area and produc- 
tion. Harvested area up 328% 
from 1970. 

Cool wet spring-planting delayed 
in North. 

Hail and heavy rains in Central. 

Hot, dry July. 

Nitrogen rate/acre down 3%. 

Era accounts for 65% and Chris 6% 
of area. 

Price paid for wheat up 226%. 


Yield up 7%. 

Record harvested area and produc- 
tion. 

Cold, rainy spring-planting de- 
layed . 

Hot, dry July and August. 
Nitrogen rate/acre up 4%. 


Yield up 5%-harvested area up 41% 
from 1975 and 470% from 1970. 

Record production and harvested 
area.. ELanting 2-3 weeks early- 
warmer, drier than normal. 

Very dry in South and Central dur- 
ing summer, but adequate rain in 
Red River Valley. 

Nitrogen rate/acre up 14%. 

Yield up 23%-record yield and 
production. 

Early planting and sprouting. 

Moisture, temperature adequate 
through summer. 

Harvest normal to slightly late. 

Nitrogen rate/acre up 2%. 


Ye ar 

1978 


1979 
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Brief Descripcion of Growing Conditions for 
Spring Wheat in Bootstrap Test Years 


North Dakota 


Minnesota 


Yield up 20%-highest yield since 
1971. 

Production up 24%. 

Very good growing conditions. 

Frequent rains early in season. 

Hot, dry mid July-September. 

Harvest early. 

Nitrogen rate/acre jip 1‘3%. 

Olaf accounts for 35% and 
Waldron 28% of area. 

Yield down 12%-production down 

114 %. 

Cold wet soring- planting de- 
layed. 

Hot dry mid- June. 

Cool August with heavy rains 
and lodging in the East, 
hail damage in East and 
Central . 

Premature frost in Northwest 
(mid- August) . 

Nitrogen rate/acre up 24%. 


Yield down 16%-production down 31%. 
Lowest harvested area since 1973. 
Good early season weather. 

Heavy rain, wind in early summer. 
Harvest slowed by wet weather- 
much lodging occurs. 

Nitrogen rate/acre up 7%. 


Yield up 44%. 

Lowest production since 1975. 
Spring planting and development 
2 weeks late. 

Good growing conditions throughout 
season. 

Normal precipitation in Red River 
area. 

Nitrogen rate/acre up 7%. 
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